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(54) Storage system supporting file-level and block-level accesses 

(57) One embodiment of the present invention pro- 
vides a storage system that services access requests 
received from a computer system. In a first mode of 
operation, the storage system receives a file system 
access from the computer system across a communica- 
tion channel. This file system access includes an identi- 
fier for a file and an offset into the file. The storage 
system translates this file system access into a block- 
level access, which includes a device number and a 
block number. This block-level access is forwarded to a 
storage device. In a second mode of operation, the stor- 
age system receives block-level access, which includes 
a device number and a block number. The storage sys- 
tem forwards this block-level access to the storage 
device. In a variation on the above embodiment, during 
the second mode of operation, after receiving the btock- 
level access, the system passes the block-level access 
through a storage device emulator, then through a 
cache for the storage device. If the block level access 
cannot be serviced within the cache, the system passes 
the block-level access through a driver for the storage 
device before forwarding the block-level access to the 
storage device. 
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Description 
BACKGROUND 

Field of the Invention 5 

[0001] The present invention relates to secondary 
storage systems for computers. More specifically, the 
present invention relates to a secondary storage system 
that supports both file-level and block-level access pro- io 
tocols. 



Related Art 

[0002] As processor clock speeds continue to is 
increase at an exponential rate and the price of semi- 
conductor memories continues to fall, it is becoming 
possible to incorporate larger amounts of processing 
power and semiconductor memory into secondary stor- 
age devices, such as disk drives. This additional 20 
processing power and memory is being used to buffer 
requests into secondary storage devices in order to 
minimize the number of accesses to rotating storage 
Accessing rotating storage can severely limit processor 
performance because at current processor clock 25 
speeds it is possible to execute millions of instructions in 
the time it takes to retrieve a single block of data from 
rotating storage. 

[0003] Unfortunately, protocols that are typically 
used by computers to communicate with secondary 30 
storage systems were designed presuming that the sec- 
ondary storage systems possess very little processing 
power and semiconductor memory. Common protocols 
such as the SCSI protocol, present device-specific com- 
mands at the block-level. For example, a read operation 35 
to a disk may include a device number that identifies a 
disk to which the read operation is directed, and a block 
or track number, which specifies the block or track that 
is to be retrieved from the disk during the read opera- 
tion. 

40 

[0004] Upon receiving a block-level command 
intelligent secondary storage systems typically process 
the command using a software emulator that emulates 
an unsophisticated disk drive. This software emulator 
uses the block-level request to lookup entries in a cache 4s 
of disk blocks that are maintained within semiconductor 
memory in the secondary storage system. In some 
cases, this block-level access ultimately results in an 
access to the disk. This access to the disk must pass 
through a device driver for the disk, which converts the 50 
access back into a form that is suitable for communica- 
tion with the disk. 

[0005] Consequently, many of the processing oper- 
ations performed by an intelligent secondary storage 
system are spent undoing a conversion into a block- 55 
level format and then redoing the conversion to create a 
request for the disk drive. 

[0006] What is needed is an intelligent secondary 



storage system that is able to process higher-level file 
access commands so that lower-level format conversion 
operations do not need to be undone and then redone 
by the storage system. 

[0007] However, if such a storage system is devel- 
oped, this storage system would only be compatible 
with computer systems that are configured to send 
higher-level file access commands to a storage device. 
Such a storage system would not be compatible with 
existing computer systems that provide commands in a 
block-level format. 

[0008] What is needed is an intelligent storage sys- 
tem that is able to process both higher-level file access 
commands and lower-level block access commands. 

SUMMARY 

[0009] One embodiment of the present invention 
provides a storage system that services access 
requests received from a computer system. In a first 
mode of operation, the storage system receives a file 
system access from the computer system across a 
communication channel. This file system access 
includes an identifier for a file and an offset into the file 
The storage system translates this file system access 
into a block-level access, which includes a device 
number and a block number. This block-level access is 
forwarded to a storage device. In a second mode of 
operation, the storage system receives block-level 
access, which includes a device number and a block 
number. The storage system forwards this block-level 
access to the storage device. 

[0010] In a variation on the above embodiment, dur- 
ing the second mode of operation, after receiving the 
block-level access, the system passes the block-level 
access through a storage device emulator, then through 
a cache for the storage device. If the block level access 
cannot be serviced within the cache, the system passes 
the block-level access through a driver for the storage 
device before forwarding the block-level access to the 
storage device. 

[001 1 ] in a variation on the above embodiment, the 
file system access is received from a client-side portion 
of a file system and is translated into a block-level 
access within a server-side portion of the file system. 
[0012] In a variation on the above embodiment, the 
file system access is received from one of a plurality of 
processors coupled to the storage system. 

BRIEF DESCRIPTION OF THE FIGURES 



[0013] 



FIG. 1 illustrates a storage system coupled to a plu- 
rality of computers in accordance with an embodi- 
ment of the present invention. 
FIG. 2 illustrates system layers involved in perform- 
ing a file system access wherein block-level com- 
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mands are transferred to a storage system in 
accordance with an embodiment of the present 
invention. 

FIG. 3 illustrates system layers involved in perform- 
ing a file system access wherein file-level com- 
mands are transferred to a storage system in 
accordance with an embodiment of the present 
invention. 

FIG. 4A illustrates some of the items within a file 
system access in accordance with an embodiment 
of the present invention. 

FIG. 4B illustrates some of the items within a block- 
level access in accordance with an embodiment of 
the present invention. 

FIG. 5 is a flow chart illustrating operation of a stor- 
age system in accordance with an embodiment of 
the present invention. 

DETAILED DESCRIPTION 

[0014] The following description is presented to 
enable any person skilled in the art to make and use the 
invention, and is provided in the context of a particular 
application and its requirements. Various modifications 
to the disclosed embodiments will be readily apparent to 
those skilled in the art, and the general principles 
defined herein may be applied to other embodiments 
and applications without departing from the spirit and 
scope of the present invention. Thus, the present inven- 
tion is not intended to be limited to the embodiments 
shown, but is to be accorded the widest scope consist- 
ent with the principles and features disclosed herein. 
[0015] The data structures and code described in 
this detailed description are typically stored on a com- 
puter readable storage medium, which may be any 
device or medium that can store code and/or data for 
use by a computer system. This includes, but is not lim- 
ited to, magnetic and optical storage devices such as 
disk drives, magnetic tape, CDs (compact discs) and 
DVDs (digital video discs), and computer instruction sig- 
nals embodied in a transmission medium (with or with- 
out a carrier wave upon which the signals are 
modulated). For example, the transmission medium 
may include a communications network, such as the 
Internet. 

Storage System 

[0016] FIG. 1 illustrates storage system 120 cou- 
pled to computers 102-104 in accordance with an 
embodiment of the present invention. Computers 102- 
1 04 can include any type of computer that can use stor- 
age system 120 to store code/and or data. This 
includes, but is not limited to, computers based upon 
microprocessors, mainframe processors, device con- 
trollers, and computational engines within appliances. 
Note that computers 1 02-104 may include semiconduc- 
tor memory in addition to other computer system com- 



ponents. 

[0017] In the illustrated embodiment, computers 
102-104 are coupled together through network 106. 
Network 106 may include any type of wire or wireless 

5 communication channel capable of coupling together 
computers 102-104. This includes, but is not limited to, 
a local area network, a wide area network, or a combi- 
nation of networks. In one embodiment of the present 
invention, network 106 includes the Internet. 

10 [0018] In one embodiment of the present invention, 
computers 102-104 provide fault-tolerance by allowing 
failovers between computers 102-104. For example, 
suppose computer 102 is acting as a primary server 
and computer 103 is acting as a backup secondary 

15 server, If computer 102 fails, computer 103 can take 
over the server functions performed by computer 102. 
[0019] Note that the present invention can be 
applied to any type of computer system that includes an 
intelligent storage system 120 for storing code and/or 

20 data. For example, the present invention can be applied 
to a non -fault-tolerant single processor system. 
[0020] Storage system 120 includes controller 122 
and cache 124, which are coupled to storage devices 
130-133. Storage system 120 additionally includes con- 

25 troller 123 and cache 125, which are similarly coupled 
to storage devices 130-1 33. 

[0021] Note that providing two controllers 122-123 
and two caches 124 -125 allows storage system 120 to 
provide fault tolerance in cases where one of the two 

30 controllers 122-123 or one of the two caches 124-125 
fails. Also note that the present invention can addition- 
ally apply to non-fault-tolerant storage systems that 
include only a single controller and a single cache. 
[0022] Controllers 122-123 can include any type of 

35 computational devices that can be configured to act as 
controllers. During operation, controllers 122-123 man- 
age a number of components, including storage devices 
130-133 and caches 124-125. Controllers 122-123 can 
also manage mirroring of caches 124-125. This keeps 

40 caches 124 and 125 consistent with each other for fault- 
tolerance purposes. 

[0023] Caches 1 24 and 1 25 can include any type of 
random access memory for caching data from comput- 
ers 102-104. In one embodiment of the present inven- 
ts tion, caches 124-125 include non-volatile random 
access memory based upon flash memory or battery 
backed up memory. This allows a transaction to be per- 
manently committed into non-volatile storage in caches 
1 24-1 25 without having to wait for storage devices 1 30- 
50 133. 

[0024] Storage devices 130-133 can include any 
type of non-volatile storage devices for storing code 
and/or data for computers 1 02-104. This includes, but is 
not limited to, magnetic storage devices (such as disk 
55 drives or tape drives), optical storage devices and mag- 
neto-optical storage devices. This also includes non- 
volatile semiconductor storage devices, such as flash 
memories or battery-backed up random access memo- 
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ries. In one embodiment of the present invention stor- 
age, storage devices 130-133 include disk drives. 
[0025] Note that computer 102-104 are coupled 
with storage system 120 through communication links 
1 08-1 1 0. In embodiment of the present invention, com- s 
munication links 108-110 adhere to the fiber channel 
standard. 

[0026] The system illustrated in FIG. 1 operates 
generally as follows. A computer, such as computer 
102, makes an access request, such as a read opera- w 
tion, to a storage system 120. Controller 122 within stor- 
age system 120 receives the access request and tries 
to satisfy the access request within local cache 124 If 
necessary, controller 122 sends a request to a storage 
device, such as storage device 130, to complete the is 
request. If the access is a read operation, storage 
device 130 returns the requested data, and controller 
122 forwards to requested data back to computer 102. 

Layers Involved in Sending Bl oc k-Lev*) fV^o^ 20 
to Storage System 



SCSI emulator 214 provides an interface that appears 
to be a dumb SCSI device, such as a disk drive. Within 
SCSI emulator 214, the block-level command is con- 
verted into a format that allows the block to be looked up 
within cache 124. If the access request cannot be serv- 
iced from entirely within cache 124, the access request 
passes through logical volume manager 21 7 to control- 
ler 218. Controller 218 passes the access request 
through SCSI device driver 220 and through SCSI to 
fiber channel converter 222 before forwarding the 
request to storage device 130. 

[0030] Note that a block level access can be serv- 
iced from cache 124 (without accessing storage device 
130) if the block-level access is a read operation, and 
the requested block is present in cache 124. During a 
write operation, a block that is written into cache 1 24 will 
eventually be written back to storage device 130. 

Layers Involved in Send in g F ile-Level rnmmon^ tn 
Storage Sy stem 



[0027] FIG. 2 illustrates system layers involved in 
performing a file system access wherein block-level 
commands are transferred to storage system 120 in 
accordance with an embodiment of the present inven- 
tion. These layers are used during one mode of opera- 
tion for storage system 120. During another mode of 
operation, storage system 120 can receive file system 
commands. 

[0028] A number of layers are illustrated within 
computer 102. Application 202 first initiates a file sys- 
tem access by executing an instruction that causes a file 
system call. This file system access may include a read 
operation, a write operation, or any other type of file 
access or file maintenance operation. The file system 
access passes into file system 204, which converts the 
file system access into lower-level commands to access 
logical blocks of storage. Logical volume manager 206 
receives these lower-level commands and converts 
them into even lower-level block access commands. 
Note that logical volume manager 206 may additionally 
perform mirroring for fault-tolerance purposes. Logical 
volume manager 206 passes the block-level commands 
to SCSI driver 208. SCSI driver 208 converts the block- 
level commands into a form that adheres to the SCSI 
protocol. SCSI driver 208 passes the commands 
through a layer that converts the SCSI protocol com- 
mand into a form that is suitable for transmission over a 
communication link that adheres to the fiber channel 
communication protocol. Note that although on embod- 
iment of the present invention is described in items of 
the SCSI protocol, the present invention can generally 
be used with other data transfer protocols. 
[0029] Within storage system 120, the block-level 
command received from computer 102 across the fiber 
channel is converted back into a SCSI protocol com- 
mand 212, and is then passed into SCSI emulator 214. 



[0031] FIG. 3 illustrates system layers involved in 
performing a file system access wherein file-level com- 
mands are transferred to a storage device in accord- 
25 ance with an embodiment of the present invention In 
this embodiment, application 202 generates a file sys- 
tem access and this access is passed into file system 
302 (which is a client-side portion of a distributed file 
system). This file system access is immediately passed 
30 into transport layer 304, which packages the file system 
access for transport across a communication link from 
computer 102 to storage system 120. 
[0032] Within storage system 120, the file system 
access passes through another transport layer which 
35 unpackages the file system access and then passes 
into file system 308 (which is a server-side portion of a 
distributed file system). 

[0033] In one embodiment of the present invention 
file system 302 (on the client side) and file system 308 
40 (on the server side) act in concert to provide high avail- 
ability. For example, suppose computer 102 fails during 
a file system operation. The highly available system 
allows a secondary backup computer, such as compu- 
ter 103, to continue operating in place of computer 102 
45 Note that the present invention also applies to computer 
systems that do not provide high availability. 
[0034] File system 308 within storage system 120 
passes the file system access to underlying file system 
310. (Note that in general any file system can used the 
so implement underlying file system 310.) Underlying file 
system 310 attempts to satisfy the file system request 
from cache 124. If a further access is required to stor- 
age device 130, the file system access is converted in a 
block-level request. This block-level request passes 
55 through logical volume manager 217 to SCSI device 
driver 220. Next, the block-level request passes through 
SCSI device driver 220 and is converted into a format 
suitable for transmission over a communication channel 
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adhering to the fiber channel standard. This block-level 
request is then forwarded to storage device 130. 
[0035] Note that the present invention allows for two 
modes of operation. A first mode of operation (illus- 
trated in FIG. 3) allows storage system 120 to accept 5 
higher-level file access commands. A second mode of 
operation (illustrated in FIG. 2) allows storage system 
120 to accept lower-level block access commands. 
[0036] The first mode of operation eliminates the 
work involved in converting an access request into a 
block-level form within computer 102, and then emulat- 
ing a simple SCSI device with storage system 120, 
which converts the access into a higher-level form that 
is subsequently converted back down into a lower-level 
form before passing to storage device 130. 
[0037] Instead, the first mode of operation sends 
the higher-level file system access directly to storage 
system 120 without first converting it into a block-level 
form. 

Access Formats 

[0038] FIG. 4A illustrates some of the components 
that make up a file system access 401 in accordance 
with an embodiment of the present invention. File sys- 
tem access 401 includes file handle 402, offset 404 and 
length 406. File handle 402 is an identifier that facilitates 
referencing a file. Offset 404 specifies an offset into the 
file and length 406 specifies a length for the request. 
Note that this length 406 can specify a single byte or 
many megabytes. Hence, a single file access can gen- 
erate one or more block accesses into a storage device. 
[0039] FIG. 4B illustrates some of the components 
that make up a block-level access 409 in accordance 
with an embodiment of the present invention. Block- 
level access 409 includes disk number 408 and block 
number 410. Disk number 408 identifies a specific disk 
(or a specific storage device) and block number 410 
specifies a particular block within the storage device. 
Note that block number 410 may specify a logical block 
or a physical block within a storage device. 
[0040] Note that file system access 401 and block- 
level access 409 also include other components, which 
are not illustrated, such as an access type, which deter- 
mines whether the access is a read operation or a write 
operation. 

Operation of Storage System 

[0041] FIG. 5 is a flow chart illustrating operation of 
storage system 120 in accordance with an embodiment 
of the present invention. 

[0042] The system first determines if it is configured 
to operate in a first mode of operation or a second mode 
of operation (step 502). In the first mode of operation, 
storage system 120 receives file system accesses, 
whereas in the second mode of operation, the file sys- 
tem receives block-level accesses. 



[0043] The configuration process can take place at 
a number of different times. Configuration can take 
place when the physical components of a computer sys- 
tem are being integrated together. This can be accom- 
plished by setting jumpers or switches to select a 
configuration. Configuration can also take place under 
program control during a system boot up operation. 
Configuration can additionally take place dynamically 
during computer system operation. 
[0044] During the first mode of operation, storage 
system 120 receives a file system access (step 504). 
Storage system 120 translates the file system access 
401 into a block-level access 409 (step 506). This block- 
level access 409 is subsequently forwarded to storage 
device 130 (step 508). 

[0045] During the second mode of operation, stor- 
age system 1 20 receives a block-level access 409 (step 
510). Block-level access 409 passes through SCSI 
emulator 21 4 (step 512) and through disk controller 218 
(step 514). Block-level access 409 additionally passes 
through SCSI device driver 220 (step 516) before being 
forwarded to storage device 130 (step 518). 
[0046] The foregoing descriptions of embodiments 
of the invention have been presented for purposes of 
illustration and description only. They are not intended 
to be exhaustive or to limit the invention to the forms dis- 
closed. Accordingly, many modifications and variations 
will be apparent to practitioners skilled in the art. Addi- 
tionally, the above disclosure is not intended to limit the 
invention. The scope of the invention is defined by the 
appended claims. 

Claims 

1. A method for servicing access requests directed to 
a storage system (120) within a computer system, 
comprising: 

if the storage system is operating in a first 
mode of operation, receiving (504) a file sys- 
tem access (401) at the storage system, trans- 
lating (506) the file system access into a first 
block- level access (409), 
and 

forwarding (508) the first block-level access to 
a storage device (130) within the storage sys- 
tem; 

if the storage system is operating in a second 
mode of operation, receiving 9510) a second 
block-level access (404) at the storage system, 
and forwarding (518) the second block-level 
access to the storage device (130). 

2. The method of claim 1 , wherein receiving the file 
system access (401) includes receiving an identifier 
(402) for a file and an offset (404) into the file. 

3. The method of claim 1 or claim 2, wherein receiving 
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the file system access (401) includes receiving the 
file system access across a communication chan- 
nel from a processor in the computer system. 

4. The method of claim 3, wherein the communication s 
channel conforms to the fiber channel standard. 

5. A method according to any preceding claim 
wherein forwarding the first block-level access 
(409) includes forwarding a device number (408) w 
and a block number (41 0). 

6. The method of claim 5, wherein the device number 
(408) identifies a disk within the storage system 
020). is 

7. A method according to any preceding claim, 
wherein receiving the second block-level access 
includes receiving a second device number (408) 
and a second block number (41 0). 20 

8. A method according to any preceding claim, 
wherein if the storage system is operating in the 
second mode of operation, the method further com- 
prises: 25 



30 



35 



after receiving the second block-level access 
(409) at the storage system (120), passing the 
second block-level access through a block stor- 
age device emulator within the storage system; 
passing the second block-level access through 
a cache (124; 125) for the storage device; and 
if the second block-level access (409) cannot 
be serviced by the cache, passing the second 
block-level access through a driver (220) for the 
storage device (130) before forwarding the sec- 
ond block-level access to the storage device. 

9. A method according to any preceding claim, 
wherein receiving the file system access at the stor- 40 
age system (302) includes receiving the file system 
access from a client-side portion of a file system- 
and 

wherein translating the file system access into the 
first block-level access includes translating the file as 
system access within a server-side portion of the 
file system. 

10. A method according to any preceding claim 
wherein the first block-level access conforms to the so 
SCSI protocol standard. 



receiving the file system access from one of a plu- 
rality of processors coupled to the storage system. 

13. A method according to any preceding claim 
wherein forwarding the first block-level access to 
the storage device includes mirroring the first block- 
level access for fault-tolerance purposes. 

14. A method according to any preceding claim, 
wherein the file system access additionally includes 
an access length (406). 

15. An apparatus for storing data for a computer sys- 
tem (1 02; 1 03; 1 04), comprising: 

a storage system (120); 

a first communication channel (108; 109; 110) 
that couples the storage system to the compu- 
ter system; 

a storage device within the storage system, 
including a non-volatile storage medium; 
a second communication channel that couples 
the storage system to the storage device- and 
a controller (122; 123) within the storage sys- 
tem coupled between the first communication 
channel and the second communication chan- 
nel, for co-ordinating operation of the storage 
system; 

wherein during a first mode of operation, the 
controller is configured to, 

receive (504) a file system access (401) at 
the storage system, translate (506) the file 
system access into a first block-level 
access (409), forward (508) the first block- 
level access to the storage device; 
wherein during a second mode of opera- 
tion, the controller is configured to, 
receive (510) a second block-level access 
(409) at the storage system, and forward 
(518) the second block-level access to the 
storage device. 

16. The apparatus of claim 15, wherein the file system 
access (401) includes an identifier (402) for a file 
and an offset (404) into the file. 



17. 



The apparatus of claim 15 or claim 16, wherein the 
first block-level access (409) includes a device 
number (408) and a block number (410). 



11. A method according to any preceding claim 
wherein the file system access conforms to the 
POSIX standard. 

12. A method according to any preceding claim 
wherein receiving the file system access includes 



55 



18. The apparatus of claim 17, wherein the device 
number (408) identifies a disk within the storage 
system (120). 

19. An apparatus according to any one of claims 15 to 
18, wherein the second block-level access includes 
a second device number (408) and a second block 
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number (410). 

20. An apparatus according to any one of claims 15 to 
1 9, wherein if the storage system is operating in the 
second mode of operation, the controller is further s 
configured to: 



if the storage system is operating in a second 
mode of operation, receiving a second block- 
level access at the storage system, and for- 
warding the second block-level access to the 
storage device. 



pass the second block-level access through a 
block storage device emulator within the stor- 
age system; and 10 
if the second block level-access cannot be 
serviced within the cache (124, 125), to pass 
the second block- level access through a driver 
for the storage device before forwarding the 
second block-level access to the storage is 
device. 



21. The apparatus according to any one of claims 15 to 

20, further comprising a server-side portion of a file 
system within the storage device, and wherein the 20 
controller is configured to receive the file system 
access from a corresponding client-side portion of 

the file system. 

22. The apparatus according to any one of claims 1 5 to 25 

21, wherein the first communication channel con- 
forms to the fiber channel standard. 



23. The apparatus according to any one of claims 15 to 

22, wherein the first block-level access conforms to 30 
the SCSI protocol standard. 

24. The apparatus according to any one of claims 15 to 

23, wherein the file system access conforms to the 
POSIX standard. 35 



25. The apparatus according to any one of claims 15 to 
24, further comprising a third communication chan- 
nel that couples the storage device to a second 
computer system. 40 



26. The apparatus according to any one of claims 15 to 

25, wherein the controller is configured to mirror the 
first block-level access for fault-tolerance purposes. 

27. The apparatus according to any one of claims 15 to 

26, wherein the file system access additionally 
includes an access length. 



28. A computer readable storage medium storing so 
instructions that when executed by a controller 
(122; 123) within a storage system (120) cause the 
controller to perform a method for servicing access 
requests directed to the storage system according 
to any one of claims 1 to 14 55 

forwarding the first block-level access to a stor- 
age device within the storage system; 
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(57) One embodiment of the present invention pro- 
vides a storage system that services access requests 
received from a computer system. In a first mode of op- 
eration, the storage system receives a file system ac- 
cess from the computer system across a communica- 
tion channel. This file system access includes an iden- 
tifier for a file and an offset into the file. The storage sys- 
tem translates this file system access into a block-level 
access, which includes a device number and a block 
number. This block-level access is forwarded to a stor- 
age device. In a second mode of operation, the storage 
system receives block-level access, which includes a 
device number and a block number. The storage system 
forwards this block-level access to the storage device. 
In a variation on the above embodiment, during the sec- 
ond mode of operation, after receiving the block-level 
access, the system passes the block-level access 
through a storage device emulator, then through a 
cache for the storage device. If the block level access 
cannot be serviced within the cache, the system passes 
the block-level access through a driver for the storage 
device before forwarding the block-level access to the 
storage device. 
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